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DESCRIPTION 
TIME-SERIES DATA PROCESSING DEVICE AND METHOD 
Technical Field 

The present invention relates to the analyzing process and system for 
games of sport that involve a number of players like soccer, ice hockey, rugby, 
American football, and basketball, and more particularly related to the 
analyses of individual players and movements of the team. 
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* s 5f Background Art 



In currently existing game analysis system, video recorded images of 
the game appears on the screen, and a specific player is marked by using an 
electric pen for games like soccer, American football, and basketball. The 

15 player's expected movement in the next sequence is drawn as a line by using 
the electric pen, and then it is overlapped onto the actual images of the next 
sequence to explain the positioning and player movement. 

The actual movement of a player who receives the ball in the offense 
of an American football game would be explained as an example. First, the 

20 initial position of the objective player (OP) is marked with the electric pen. 
At this point, the player (OP) has not yet received the ball. Next, the 
position of player (BP) currently in possession of the ball will be marked. 
Then, the track of player OP can be traced until just before BP passes him 
the ball. Finally, the points where BP releases and OP receives the ball will 

25 be marked on the field screen to analyze how the ball was passed from BP to 
OP. 

Likewise, the player movements on the defensive player also can be 
analyzed simultaneously on the same image. In other words, the defensive 
player who is covering OP man on man can be analyzed by tracing the track 
30 of OP. 
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However, although the above-mentioned system enables a simple 
analysis for positioning or movement of individual players, it does not allow 
a statistical analysis for positioning or movement of players in related to 
team formations. 

5 

Disclosure of Invention 

Accordingly, it is an object of the present invention to provide a 
system that facilitates various visual analyses of individual players and 
team data that is most appropriate for the purpose, while also allowing 

(IRS 

! r 10 analyzed data and results to be saved. 

* 0 The objective of the present invention can be achieved by a time- 

ly 

*.S series data processing device, which includes an image-pick up unit for 

vq image-picking up a specific object, a data processing umt for generating a 

J 9 data list indicating, in time series, a temporal transition of a position and a 

|;i 15 state of the object image-picked up by the image-picking unit, with respect to 
l;3 a time, an animating unit for animating the transition of the position and 

p the state of the object in accordance with the data list, and a display unit for 

displaying at least one of the data list generated by the data processing unit 
and the image animated by the animating unit. 
20 Preferably, in the time-series data processing device according to the 

present invention, the data processing unit is configured to display 
synchronously on the display unit each corresponding image by linking an 
image of the object, which is image-picked up by the image-pick up unit, if 
necessary, in accordance with the data list generated, when the display unit 
25 displays the image of the object animated by animating unit. 

More preferably, in the time-series data processing device according 
to the present invention, the data processing unit is configured to perform at 
least one kind of data analysis, by linking an image animated by the 
animating unit, in accordance with the data list generated. 
30 Further preferably, in the time-series data processing device 
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according to the present invention, the specific object includes a tool that is 
used for players in a sports game and for a determination of a winner or a 
loser of the sports game. 

In the time-series data processing device according to the present 
invention, the sports game is a soccer, and the tool is a soccer ball, preferably. 

The above-mentioned objective of the present invention can be 
achieved by a time-series data processing device, which includes a data 
processing unit for generating an image data by image-picking up a sports 
game, for processing the image data generated in accordance with a 
predetermined format, and for storing the data processed in the 
predetermined format, an interface unit connected to the data processing 
unit, and having an instruction entering unit capable of entering a plurality 
of instructions, for inputting the data processed in the predetermined format 
that is stored in the data processing unit and for converting the data 
inputted into a predetermined form, and for outputting the data converted, 
in accordance with the instruction entered by the instruction entering unit, 
and an image displaying unit connected to the interface unit for inputting 
the data outputted from the interface unit and for displaying the data 
inputted on a screen. 

Preferably, in the time-series data processing device according to the 
present invention, the interface unit is configured to enable the image 
displaying unit to display a play list or a graph that is indicative of a desired 
analytical result in response to a kind of the instruction. 

More preferably, in the time-series data processing device according 
to the present invention, the instruction entering unit includes a main 
instruction entering level for performing a plurality of different kinds of 
analyses, and a common instruction entering level to be utilized commonly 
for the plurality of different kinds of analyses. 

Further preferably, in the time-series data processing device 
according to the present invention, the common instruction entering level is 



configured to enter at least one or more related item(s) with respect to a 
sports game subject to an analysis. 

In the time-series data processing device according to present 
invention, the main instruction entering level is configured to select an 
5 analysis of data or an analysis of formation regarding to a sports game 
subject to an analysis, as one of the plurality of different kinds of analyses, 
preferably. 

It is preferably in the time-series data processing device according to 
the present invention that the related item includes at least one of a player, a 
l % 10 team, a weather, a stadium of a game, a date of a game, a starting time of a 
■ Q game, and a number of spectators of a game. 

[q In the time-series data processing device according to present 

invention, it is preferably that the interface unit includes functions of 
displaying all plays of an opponent teams at the sports game as a list in 
H 15 accordance with the play list, and of retrieving a desirable play seen at the 
sports game by designating an optional item of the play fist. 

In the time-series data processing device according to the present 
invention, preferably, the interface unit further includes a function of linking 
one analysis to other analysis in accordance with the play list. 
20 In the time-series data processing device according to the present 

invention, it is preferably that the interface unit is capable of enabling the 
display unit to display simultaneously an animation based on the data 
converted into the predetermined form in accordance with the play list, and 
an image of a sports game based on the image data corresponding to the 
25 animation, and of editing a video of the sports game while analyzing data of 
the sports game. 

It is another object of the present invention to provide a method that 
facilitates various visual analyses of individual players and team data that is 
most appropriate for the purpose, while also allowing analyzed data and 
30 results to be saved. 
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The object of the present invention can be achieved by a method of 
processing data in time-series, which includes the steps of image-picking up 
a specific object, generating a data list indicating, in time series, a temporal 
transition of a position and a state of the object image-picked up, with 
5 respect to a time, animating the transition of the position and the state of the 
object in accordance with the data list, and displaying at least one of the data 
list generated and the image animated. 

Preferably, the method of processing data in time-series according to 
the present invention further includes the step of displaying synchronously 
? 10 each corresponding image by linking an image of the object, which is image- 
*S picked up, if necessary, in accordance with the data list generated, when 

[q displaying the image of the object animated. 

!;2 More preferably, the method of processing data in time-series 

^ according to the present invention further includes the step of performing at 

V 

! j 15 least one kind of data analysis, by linking an image animated, in accordance 
q with the data list generated. 

:E Further preferably, in the method of processing data in time series 

Q 

^ according to the present invention, the specific object includes a tool that is 

used for players in a sports game and for a determination of a winner or a 
20 loser of the sports game. 

In the method of processing data in time-series according to the 
present invention, the sports game is a soccer, and the tool is a soccer ball, 
preferably. 

The above-mentioned object of the present invention can also be 
25 achieved by a method of processing data in time-series, which includes the 
steps of generating an image data by image-picking up a sports game, 
processing the image data generated in accordance with a predetermined 
format, storing the data processed in the predetermined format, entering a 
plurality of instructions, converting the data processed in the predetermined 
30 format into a predetermined form in accordance with the instruction entered, 
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and displaying the data converted into thed predetermined form. 

Preferably, the method of processing data in time-series according to 
the present invention further includes the step of displaying a play list or a 
graph that is indicative of a desired analytical result in response to a kind of 
the instruction. 

More preferably, in the method of processing data in time-series 
according to the present invention, the step of converting the data processed 
in the predetermined format into a predetermined form in accordance with 
the instruction includes the step of entering at least one or more related 
item(s) with respect to a sports game subject to an analysis, which is utilized 
commonly in the plurality of different kinds of analyses by a common 
instruction entering. 

. Further preferably, in the method of processing data in time-series 
according to the present invention, the related item includes at least one of a 
player, a team, a weather, a stadium of a game, a date of a game, a starting 
time of a game, and a number of spectators of a game. 

In the method of processing data in time-series according to the 
present invention, the step of converting the data processed in the 
predetermined format into a predetermined form in accordance with the 
instruction preferably includes the step of selecting an analysis of data or an 
analysis of formation regarding to a sports game subject to an analysis by a 
main instruction entering. 

The method of processing data in time-series according to the present 
invention further includes the steps of displaying all plays of an opponent 
teams at the sports game as a list in accordance with the play list, and 
retrieving a desirable play seen at the sports game by designating an 
optional item of the play list, preferably. 

The method of processing data in time-series according to the present 
invention further includes the step of linking one analysis to other analysis 
in accordance with the play list, preferably. 
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It is preferably that the method of processing data in time-series 
according to the present invention further includes the steps of displaying 
simultaneously an animation based on the data converted into the 
predetermined form in accordance with the play list, and an image of a 
5 sports game based on the image data corresponding to the animation, and 
editing a video of the sports game while analyzing data of the sports game. 

Brief Description of Drawings 

Figure 1 is a block diagram showing a structure of the sports game 
1 2 10 analysis system according to the present invention; 

Figure 2 is a flow chart explaining an operation of the system shown 
in Figure 1; 

Figure 3 is a flow chart explaining a different operation of the system 
shown in Figure 1; 

15 Figure 4 is a schematic view showing a match list input screen of the 

system shown in Figure 1; 

Figure 5 is a schematic view showing an example of the match list 
input screen shown in Figure 4 after the data has been inputted; 

Figure 6 is a schematic view showing a sample screen as a result of 
20 the match list search shown in Figure 5; 

Figure 7 is a schematic view showing a formation analysis screen 
resulting from the match list search shown in Figure 6; 

Figure 8 is a schematic view showing a sample formation analysis 
interface screen of the system shown in Figure 1; 
25 Figure 9 is a schematic diagram showing a sample database obtained 

from the automatic tracking device shown in Figure 1; 

Figure 10 is a schematic view showing a structure and a function of a 
formation analysis interface screen; 

Figure 11 is a schematic view showing an official data output area of 
30 the formation analysis interface screen shown in Figure 10; 
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Figure 12 is a flow chart explaining an operation of an official data 
output area tool; 

Figure 13 is a schematic view showing a time reset slider of the 
formation analysis interface screen shown in Figure 10; 

Figure 14 is a schematic view showing a direct time input window of 
the time reset-slider of the formation analysis interface screen shown in 
Figure 10; 

Figure 15 is a schematic view showing a playback speed adjustment 
pull-down menu of the formation analysis interface screen shown in Figure 
10; 

Figure 16 is a schematic view showing a formation (position) set up 
at a time of a player change of the formation analysis interface screen shown 
in Figure 10; 

Figure 17 is a schematic view showing the movie playback control 
buttons of the formation analysis interface screen shown in Figure 10; 

Figure 18 is a schematic view showing an acquisition of individual 
play data of the formation analysis interface screen shown in Figure 10; 

Figure 19 is a flow chart explaining an operation of the acquisition 
process of individual play data shown in Figure 18; 

Figure 20 is a detailed data chart showing a subject match of the 
formation analysis interface screen shown in Figure 10; 

Figure 2 1 is a schematic view showing an enlargement of the data 
chart shown in Figure 20; 

Figure 22 is a flow chart explaining an operation of a detailed data of 
the subject match shown in Figure 20; 

Figure 23 is a schematic view showing a play list <play package 
management > of the formation analysis interface screen shown in Figure 
10; 

Figure 24 is a schematic view showing an example of the play list of 
the formation analysis interface screen shown in Figure 10; 
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Figure 25 is a flow chart explaining an operation of the play list 
output button shown in Figure 23; 

Figure 26 is a schematic view showing an example of an overall play 
list of the game; 

Figure 27 is a schematic view showing an example of a play list of an 
individual player; 

Figure 28 is a schematic view showing an example of the video 
playback tool <playback from list search> of the formation analysis interface 
screen shown in Figure 10; 

Figure 29 is a schematic view showing an example of the general 
camera angle (main analysis image) shown in Figure 28; 

Figure 30 is a flow chart explaining the video playback tool shown in 
Figure 28; 

Figure 31 is a schematic view showing an image taken from the 
stand opposite the goal shown in Figure 28; 

Figure 32 is a schematic view showing an image taken from the front 
of the goal shown in Figure 28; 

Figure 33 is a schematic view showing an image taken from the left 
main stand shown in Figure 28; 

Figure 34 is a schematic view showing an image taken from the 
ground (mobile camera) shown in Figure 28; 

Figure 35 is a schematic view showing an image taken from behind 
the goal net shown in Figure 28; 

Figure 36 is a schematic view showing an image taken from the 
corner shown in Figure 28; 

Figure 37 is a schematic view showing the chalking tool of the 
formation analysis interface shown in Figure 10; 

Figure 38 is a flow chart illustrating the operation of the chalking 

tool; 

Figure 39 is a schematic view showing the change of subject player 
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tool of the formation analysis interface shown in Figure 10; 

Figure 40 is a flow chart illustrating the operation of the change of 
subject player tool shown in Figure 39; 

Figure 41 is a schematic diagram showing the enlargement / 
reduction magnifying glass display tool of the formation analysis interface 
screen shown in Figure 10; 

Figure 42 is a flow chart illustrating the display enlargement / 
reduction magnifying glass tool shown in Figure 41; 

Figure 43 is a schematic view showing the field block display tool of 
the formation analysis interface screen shown in Figure 10; 

Figure 44 is a flow chart illustrating the field block display tool 
shown in Figure 43; 

Figure 45 is a schematic view showing the player position color- 
coding tool of the formation analysis interface screen shown in Figure 10; 

Figure 46 is a flow chart illustrating the player position color-coding 
tool shown in Figure 45; 

Figure 47 is schematic view showing the viewpoint change tool of the 
formation analysis interface screen shown in Figure 10; 

Figure 48 is a flow chart illustrating the viewpoint change tool shown 
in Figure 47; 

Figure 49 is a schematic view showing the changed player's activity 
area OL display tool of the formation analysis interface screen shown in 
Figure 10; 

Figure 50 is a flow chart illustrating the changed player's activity 
area OL display tool shown in Figure 49; 

Figure 51 is a schematic view showing the tool to translate data into 
numeric values of the formation analysis interface screen shown in Figure 
10; 

Figure 52 is a flow chart illustrating the tool to translate data into 
numeric values shown in Figure 51; 
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Figure 53 is a schematic view showing the open space display tool of 
the formation analysis interface screen shown in Figure 10; 

Figure 54 is a flow chart illustrating the open space display tool 

shown in Figure 53; 

Figure 55 is a schematic view showing the rearmost line 
advancement display tool of the formation analysis interface screen shown in 
Figure 10; 

Figure 56 is a flow chart illustrating the rearmost line advancement 
display tool shown in Figure 55; 

Figure 57 is a schematic view showing the player movement track 
display tool of the formation analysis interface screen in Figure 10; 

Figure 58 is a flow chart illustrating the player movement track 
display tool shown in Figure 57; 

Figure 59 is a schematic view showing the positional relationship 
display tool of the formation analysis interface screen shown in Figure 10; 

Figure 60 is a flow chart illustrating the positional relationship 
display tool shown in Figure 59; 

Figure 61 is a schematic view showing the advancement vector 
display tool of the formation analysis interface screen shown in Figure 10; 

Figure 62 is a flow chart illustrating the advancement vector display 
tool shown in Figure 61; 

Figure 63 is a schematic view showing a sample screen of the data 
analysis top menu of the analysis system shown in Figure 1; 

Figure 64 is a schematic view showing the screen of the Individual 
Data Analysis Subject Player Selection Menu; 

Figure 65 is a schematic view showing the screen of the Team Data 
Analysis Subject Player Selection Menu; 

Figure 66 is a schematic view showing a sample of the individual 
data screen that appears after the field player has been selected in the 
Individual Data Analysis Subject Player Selection Menu shown in Figure 64; 
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Figure 67 is a schematic view showing a sample of the individual 
play data (pass number) screen that appears when the pass number is 
clicked under individual data on the individual data screen shown in Figure 
66; 

5 Figure 68 is a schematic view showing a sample of the team data 

screen displaying the list of team data, such as the total number of shoots 
made by the team, that is selected as the subject of analysis from the team 
data analysis subject selection menu; 

Figure 69 is a schematic view showing a sample screen of the team 
"3 10 play data <passes> that appears when the number under passes is clicked 

-0 

*J3 under the team play data on the team data screen shown in Figure 68; 

J = Figure 70 is a flow chart illustrating the operation of the Individual 

S Related Detailed Data Menu of the analysis system shown in Figure 1; 

ty 

*=Q Figure 71 is a schematic view showing the table of contents of the 

M- 15 Individual Related Detailed Data Menu shown in Figure 70; 
j= 3 Figure 72 is a schematic view showing a sample shoot tracks line 

S diagram of the Individual Related Data shown in Figure 71; 

M . Figure 73 is a flow chart illustrating the operation of the shoot track 

diagram shown in Figure 72; 
20 Figure 74 is a graph showing the change in moving speed of the 

Individual Related Data shown in Figure 71; 

Figure 75 is a flow chart illustrating the operation of the change of 
moving speed tool shown in Figure 74; 

Figure 76 is a graph showing the change in moving distance in the 
25 individual related data shown in Figure 71; 

Figure 77 is a flow chart illustrating the operation of the change in 
moving distance tool shown in Figure 76; 

Figure 78 is a schematic view showing the activity area comparison 
diagram between the two halves of the game in the individual related data in 
30 Figure 71; 
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Figure 79 is a flow chart illustrating the operation of the activity 
area comparison diagram between the two halves of the game tool shown in 
Figure 78; 

Figure 80 is a schematic view showing the line diagram of the pass 
5 route of the individual related data shown in Figure 71; 

Figure 81 is a flow chart illustrating the operation of the pass route 
tool shown in Figure 80; 

Figure 82 is a flow chart illustrating the operation of the team 
related detailed data menu of the analysis system in Figure 1; 
Q io Figure 83 is a schematic view showing the table of contents of the 

team related detailed data menu shown in Figure 82; 

Figure 84 is a schematic view showing the area distribution of 
S committed fouls in the team related detailed data menu shown in Figure 82; 

t i ! 

Figure 85 is a flow chart illustrating the operation of the area 
distribution of committed fouls tool shown in Figure 84; 

Figure 86 is a schematic view showing the shoot side tendency of the 
team related data shown in Figure 83; 

Figure 87 is a flow chart illustrating the operation of the shoot side 
tendency tool shown in Figure 86; 

Figure 88 is a schematic view showing the shoot track diagram of the 
team related detailed data shown in Figure 83; 

Figure 89 is a flow chart illustrating the operation of the shoot track 
diagram tool shown in Figure 88; 

Figure 90 is a graph showing the shoot distance tendency of the team 
25 related detailed data shown in Figure 83; 

Figure 91 is a flow chart illustrating the operation of the shoot 
distance tendency tool shown in Figure 90; 

Figure 92 is a graph showing the distance between top and bottom 
lines during defense in the team related detailed data shown in Figure 83; 
30 Figure 93 is a flow chart illustrating the operation of the distance 
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between top and bottom line during defense tool shown in Figure 92; 

Figure 94 is a graph showing the defensive/offensive tendency of the 
team related detailed data shown in Figure 83; 

Figure 95 is a flow chart illustrating the defense/offense tendency 
tool shown in Figure 94; 

Figure 96 is a graph showing the change in ball control rate in the 
team related detailed data shown in Figure 83; 

Figure 97 is a flow chart illustrating the change in ball control rate 
tool shown in Figure 96; 

Figure 98 is a schematic view showing the ball control rate by area in 
the team related detailed data shown in Figure 83; 

Figure 99 is a flow chart illustrating the ball control rate by area tool 
shown in Figure 98; 

Figure 100 is a schematic view showing the ball rotation track during 
offense in the team related detailed data shown in. Figure 83; 

Figure 101 is a flow chart illustrating the ball rotation track during 
offense tool shown in Figure 100; 

Figure 102 is a schematic view showing the pass route diagram in 
the team related detailed data shown in Figure 83; 

Figure 103 is a flow chart illustrating the pass route diagram tool 
shown in Figure 102; and 

Figure 104 is a schematic view showing the pass route diagram 
between a specified player and the players listed in Figure 102. 

Figure 105 is a diagram for illustrating a function of the digital video 
set tool in another embodiment of the present invention; 

Figure 106 is a diagram for illustrating a function of the field block 
display tool in another embodiment of the present invention; 

Figure 107 is an explanatory diagram at a time when implementing 
the masking using the field block display tool shown in Figure 106; 

Figure 108 is a diagram for illustrating the player position color- 
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coded tool in another embodiment of the present invention; 

Figure 109 is an explanatory diagram at a time when displaying the 
players in different colors using the player position color-coded tool shown in 
Figure 108; 

Figure 110 is a diagram for illustrating a function of the subject 
player change tool in another embodiment of the present invention; 

Figure 111 is a diagram for illustrating a function of the positional 
relationship display tool in another embodiment of the present invention; 

Figure 112 is a diagram for illustrating a function of the direction 
vector display tool in another embodiment of the present invention; 

Figure 113 is a diagram for illustrating a function of a referee tool in 
another embodiment of the present invention; 

Figure 114 is a view showing the pass route diagram in another 
embodiment of the present invention; 

Figure 115 is a view showing the referee activity diagram for the first 
half and the second half in another embodiment of the present invention; 
and 

Figure 116 is a view showing the play list diagram in another 
embodiment of the present invention. 

Best Mode for Carrying Out the Invention 

In the followings, with reference to the accompanying drawings, the 
preferred embodiments of a time-series data processing system and a time- 
series data processing method according to the present invention will be 
described in details. 

Figure 1 is a schematic block diagram showing a structure of a game 
analysis system, which is one embodiment of the time-series data processing 
system of the present invention. 

As shown in Figure 1, the game analysis device 10 is constituted of an 
automatic tracking device 20, an interface 30 connected to an automatic 
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tracking device 20 (to be described below), a memory device 40 connected to 
the interface 30, and an image display device 50 connected to the interface 
30. 

The automatic tracking device 20 is constituted of a camera 21 to 
visually record the game, an image data processing device 22 connected to 
the camera 21 that processes the image data recorded, and a memory device 
23 connected to the data processing device 22 that saves the processed data. 

The interface 30 is constituted of an input/output device 31, and a 
control device 32 connected to the input/output device 31. The input/output 
device 31 inputs processed data from the automatic tracking device 20 to 
provide controlled data through the control device 32 for the image display 
device 50. 

The memory device 40 is structured to save data used by the 
interface 30 as necessary. 

The image display device 50 displays the data provided from the 
interface 30, and also performs the function of enabling to communicate with 
the interface 30 through the icons displayed on the screen. 

In the following, the operation of the game analysis system 10 will be 
described with the reference to Figures 2 and 3, with emphasis on the 
operations of the interface 30 and image display device 50. 

When the game analysis system 10 is activated, the Top Menu' 100 
appears on the image display device 50 (hereafter referred to as display) 
where either of the two options Import New Data' 101 and 'Analysis' 102 can 
be selected. The Top Menu' is derived from results of the input/output 
device 31 of the interface 30, and is necessary in order to narrow down of the 
match list for the analysis subject. 

The system is arranged to give the user the choice of selecting the 
'Obtain New Data' 101 to proceed to the 'Automatic Following Analysis 
Engine' if the data has not yet been obtained from the automatic tracking 
device 20. As shown in the diagram, the 'Automatic Following Analysis 
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Engine 5 103 includes Initial Setting/ 'Additional Input/ and 'Basic Data 
Sampling'. However, for the purpose of this example, it will be assumed 
that the automatic tracking device 20 has already obtained data. Therefore, 
the 'Analysis' 102 option is selected from the Top Menu' 100. 
5 Next, the interface 30 shows the three options on the display 50: 

'Search key input area for the game to be analyzed' 200, 'Formation Analysis' 
201 and 'Data analysis' 202. At the same time, the user will be asked to 
select either 203 'Formation Analysis' 20 1 or 'Data Analysis' 202. 

As the 'Formation Analysis' 201 is clicked, the search is begun, and 
10 the 'Formation Analysis Top Menu: Game selection (single selection only)' 
301 will appear on the screen of the display 50. 

On the other hand, as the 'Data analysis' 202 is clicked, the interface 
30 starts a search and the 'Data analysis Top Menu: Game selection 
(multiple selection)' 302 will appear on the display 50. 
15 As the 'Formation Analysis Top Menu: Game selection (single 

selection only)' 301 screen appears after the 'Formation Analysis' 201 is 
i;§ clicked, the 'Formation Analysis Screen' 400 is shown. An interaction with 

H the 'Overall Game Play List' 500 will be occurred whenever necessary. 

Likewise, as the 'Data Analysis' 202 option is clicked, the 'Data 
20 Analysis Top Menu: Game Selection (multiple selection)' 302 will appear on 
the screen. If individual player analysis is selected, 'Player selection (single 
selection only)' 601 will appear, and if individual team analysis is selected, 
'Team selection (single selection only)' 602 will appear. 

The individual player analysis will be explained first. 'Player 
25 selection (single selection only)' 601 will appear on the screen, and a player 
will be chosen from the available lists. Consequently, the screen will show 
the 'Individual Player Data (single game/multiple games)' 701. From this 
screen, the user can access to the 'Individual Player Data (play details within 
a given game) 702 and 'Graph of Related Data' 703 through the automatic 
30 tracking device 20 via the interface 30. Further, when 'Player Selection 
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(single selection only) 601 appears on the screen, the analysis selection sub- 
menu can be accessed. The user can go back to the 'Data Analysis Top 
Menu' 302 from the 'Individual Player Data (single game/multiple games)' 
701, 'Individual Player Data (play details within a given game)' 702, and 
5 'Graph of Related Data' 703 screens. 

Next, the team analysis will be explained. The 'Team Selection 
(single selection only)' 602 will appear on the screen, and a team will be 
chosen from the available lists. Consequently, the screen will show the 
'Team Data (single game/multiple games)' 801. From this screen, the 'Team 
f *j 10 Data (play details within a given game)' 802 and 'Graph of Related Data' 803 

*:B can be accessed through the memory device 23 of the automatic tracking 

l& 

Iq device 20 via the interface 30. Further, when Team Selection (single 

selection only)' 602 appears on the screen, the analysis selection sub-menu 
^ can be accessed. Also, the user can go back to the 'Data Analysis Top Menu' 

M- 15 302 from the 'Team Data (single game/multiple games)' 801, 'Team Data 
El (play details within a given game)' 802 and 'Graph of Related Data' 803 

f« screens. 

i'* Furthermore, formation analysis can be interacted with 'Individual 

Player Data (play details within a given game)' 702 and/or 'Team Data 
20 (details of play within a given game)' 802 through the 'Overall Game Play 
List' 500. Additionally, in formation analysis, the 'Player's Overall Play 
List' 900 can be accessed through 'Player Data (play details within a given 
game)' 702. 

The further details of the above-mentioned 'Formation Analysis' will 
25 be explained with reference to Figures 4 to 62. 

The 'Search key input area for the selected team for analyzed' 200 
shown in Figure 2 is constituted as shown in Figure 4. The 'Search key 
input area for the selected game to be analyzed' 200 contains 'Player 1' 211, 
'Player 2' 212, 'Player 3' 213, 'Team 1' 214, 'Team 2' 215, 'Weather' 216, 'Site' 
30 2 17, 'Date' 2 18, 'Kick off time' 2 19 and 'Number of attendance' 220. 
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The game analysis system of the present invention is arranged to 
search the match data (game list) first in both data and formation analyses 
from the 'Search key input area of the selected game to be analyzed' 200. 
Here, the user is able to select the desired search key. In other words, the 
5 user is allowed to select at least one game to a maximum of all games from 
the search keys. 

For example, as shown in Figure 5, if 'players Jo and Nakata both 
played as a member of the Japan National Team on a clear day' is searched, 
the 'Player 1' 211 option is clicked, and 'Jo' is selected from the pull- down 
ffj 10 menu, and the 'Player 2' 212 option is clicked, and 'Nakata' is selected from 
p the pull-down menu. The 'Team 1' 2 14 option is clicked and 'Japan National 

H Team' is selected. The 'Weather' 2 16 option is clicked and 'Clear' is selected 

f5 from the pull-down menu to create the search key. 

When the search is started with this sub-menu, the user would select 
• >* 15 either the 'Formation Analysis' 201 or 'Data analysis' 202. 
p The explanation will be continued assuming that 'Formation 

«-E 

|4 Analysis' 201 is selected. 

M In the example mentioned above, the heading 'Jo/Nakata/Japan 

National Iteam/Clear search results' 401 will appear as shown in Figure 6. 
20 Underneath, there will also be the headings 'single selection only' 402, 
'Search Results' 403, 'Subject of Analysis' 404, 'Addition' 405, 'Start 
Formation Analysis' 406, and 'Return' 407. 

In this example, list 408 of 'Search results' 403 show the followings: 



25 2/5 Japan National Team vs. Korea National Team Clear 

3/8 Japan National Team vs. Croatian National Team Clear 

3/12 Japan National Team vs. Brazil National Team Clear 

4/2 Japan National Team vs. Paraguay National Team Clear 

5/6 Japan National Team vs. Macau National Team Clear 

30 5/28 Japan National Team vs. UAE National Team Clear 
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6/12 Japan National Team vs. Korea National Team Clear 

6/17 Japan National Team vs. China National Team Clear 

6/29 Japan National Team vs. Argentina National Team Clear 

7/12 Japan National Team vs. Saudi Arabia National Team Clear 

Here, as explained before, the start analysis button on the bottom of 
the screen and the destination of the link will differ depending on whether 
the games were searched for 'Formation Analysis' 201 or 'Data analysis' 202. 

In the following, 'Formation Analysis' 201 will be described. 

Figure 7 shows the 'Formation Analysis-Contents set-up screen 
headings'. One game is selected (single selection only) from the match list. 
In this example, the '3/8 Japan National Team vs. Croatia National Team 
Clear' is clicked. The corresponding subject heading 409 under 'Subject of 
Analysis' 404 appears as: 

. 3/8 Japan National Team vs. Croatia National Team Clear. 

By clicking the heading 'Start Formation Analysis' (406), the user 
will proceed to the 'Formation Analysis Interface' (1000) screen, as shown in 
Figure 8. 

The 'Formation Analysis Interface' 1000 screen shown in Figure 8 is 
performed by the interface section 30 shown in Figure 1, and visually 
displays data of the database obtained through the automatic tracking 
device 20 on the image display device 50 using computer graphics (hereafter 
referred to as CG). 

The movement of the player and/or the ball appears on the CG screen 
as shown in Figure 9 derived from the translation of the changes in the x, y 
and z data coordination (translation of numeric value) of the database. 

As the automatic tracking device 20 enables to acquire the 
coordination of the image by frame, the user is able to obtain more concrete 
data for matters that could only be understood intuitively until now, such as 
the actual running speed of the players (speed and direction), and ball speed 
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(speed and direction) derived from the changes in speed of the coordinates 
(speed and direction). 

In this example, all the values for the z coordinate are set to be '0' as 
shown in Figure 9, in order to simplify the explanation of the Formation 
5 Analysis Interface 1000 in Figure 8. This shows the CG in two dimensions 
(flat), but it is also possible to utilize three dimension (3D) graphics to create 
a more realistic interface. Additionally, viewing points can be changed as 
an option, and enlargements and reductions of 3D gr aphics can also be done 
to facilitate users' comprehension. 
£3 10 The structure and function of the formation analysis interface of the 

*.B game analysis system will be explained with references to Figures 10 to 62. 

!| 1. Official Data Output Area (Figures 10, 11 and 12) 

The official records in the initial setting are displayed on progress of 
time. Although nothing other than the inputted information appears, 
M 15 information that need subtle judgments such as goals and own goals (suicide 
E3 points) will be correctly provided. As shown in Figure 11, the pull-down 

• 5 menu of the official data will appear by clicking the down arrow to the right 

of the output area, and the user can switch to another time in the official 
data in order to analyze its contents. Consequently, exact information can 
20 be obtained through the linkage to the official data. 

Figure 12 illustrates the operation flow of the official data output 
area. First, the 'Official Record Heading' will be verified (Step S12-1) for 
each frame. If text data exists as a result of the verification, it will appear 
in the official data output area (Step S12-2) for five seconds, regardless of the 
25 play back speed. After five seconds, the text data is deleted (Step S12-3). 
On the other side, it will not operate if text data does not exist (Step S12-4). 
2. Time Reset Slider (Figures 10, 13 and 14) 

The desired time period to be played back can be selected from the 
main interface by using the time reset slider. The time display is arranged 
to change automatically according to the number of frames in the data. For 
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example, if the game runs into overtime, the scale will be longer than 90 
minutes. In addition, by double clicking on the 'knob' of the time reset 
slider (the triangle shape seen in Figures 13 and 14), the window appears 
through which time can be directly inputted as an optional method for 
5 setting time. Consequently, the user is able to input the desired time length 
in order to analyze data efficiently. 

3. Play back speed adjustment pull-down menu (Figures 10 and 15) 

The playback speed of the play analysis CG can be adjusted from the 
normal speed of 90 minutes to eight times the normal speed of 7.5 minutes. 
9 10 The adjustment of playback speed increases the efficiency of th e analysis. 

4. Announcement at player change (Figure 16) 
Player changes will always appear on the screen in big letters as 

'Change' whenever it takes place since it is possible that the viewers will 
■° : continue to watch the screen without noticing it. If a player change occurs, 
15 the initial setting of the formation (position) set up screen will appear, and 
the formation will be reset on this screen after the change (Figure 16). This 
provides the user an easy interface. 

5. Movie playback control button (Figures 10 and 17) 
This button enables to set up stop play, fast forward, rewind, stop, 

20 slow playback, and video edit recording. It can be used as the control 
interface during the playbacks of analysis CG movies and videos. A 
complete correlation between CG movies and videos is made possible 
through a time coding, like if the user fast forwards the video, CG movie will 
be fast forwards as correlated. Further, by joining the two video machines 
25 each for input and output to the computer and pressing the far right (red 
circle), video can be edited during data analysis. This enables the efficient 
control of the analysis image and video materials. 

6. Obtaining the individual play data (Figures 10, 18 and 19) 
The individual player data menu screen will appear when the player 

icon is double clicked on the screen shown in Figure 18. By selecting the 
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conditions, the data on various individual plays can be searched and 
displayed. A seamless correlation with individual play data enables a more 
detailed data analysis. 

Figure 19 shows the flow after the player icon is- double clicked. 
5 First, as the player icon is double clicked (Step S19-1), the ID of the selected 
player is verified (Step S19-2) as well as the play data flags of the player 
(Step S19-3). After total number for the each type of flags P, D, S, and F, etc. 
are calculated (Step S19-4), the total number is outputted to the data 
analysis area in order to display (data analysis chart) (Step S19-5). 

10 7. Display of detailed data for the subject match (Figures 10, 20, 2 1, and 22) 
As the detailed data for the subject match tool is activated during 
formation analysis, the 'number of passes', 'number of shots', and 'ball 
control rate' as a team will appear up to a given time. For example, as 
shown in Figure 21, the team comparison data chart will be displayed. This 

15 enables an instant numerical analysis of the formation in the subject match. 

Figure 22 shows the operation flow of the detailed match data 
display. First, the show button is clicked (Step S22-1). At this time, the 
frame number (n) is verified (Step S22-2), and the play of all players and ball 
touch flags 'play flag' before the flame are also verified (Step S22-3). The 

20 number of each play flag is counted (Step S22-4), and a comparison of the 
total play number for each flag type and ball control rate are shown. This 
ends the operation. 

8. Play list chart (package management of plays) (Figure 23) 

Plays in a soccer game can be managed by dividing them into units 

25 with the dividing lines set at the times when the ball dies or is turned over. 
For example, as shown in Figure 21, one play will consist of Jo (P : pass) to 
Soma (DP : dribble/ pass) to Nakayama (S: shoot) to Boban. Like above, if 
the play is managed as one package until the shoot is blocked or the offensive 
side changes, it is possible to recall the play list and select specific plays even 

30 during formation search. This facilitates the search of a desired scene and 
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play within the flow of the game. 

9. Types of play lists (Figures 24, 25, 26 and 27) 

(a) Function and operation of the play list 

The play list shows all plays in a game regardless of the sides where 
5 plays belong to, and by double clicking on the number in the list, the desired 
scene can be searched. This list can be used as a link function independent 
of formation analysis in order to proceed to £ Data Analysis (Individual)'. To 
give a concrete example, if Mo\ who is currently turning, is double clicked on 
a screen as shown in Figure 24, the screen will change to show a detailed list 
Q 10 where all of Jo's passes (P) to in a given game can be verified. The play data 
5 at this time is linked to the play flag just after the player's name (see 

[q individual play data). 

^ Figure 25 shows the operational flow of the play list output button. 

t D First, when the play list button is pressed (Step S25-1), all the play flag ID in 

M- 15 the game will be verified (Step S25-2), and the play flags are totaled for each 
C3 player (Step S25-3). Next, the totaled play flags are thoroughly verified in 

£ order to figure out whom the play belongs (Step S25-4), As the result, if 

hssi 

^ both the player, who now has the ball, and the another player, who had the 

ball just until now, have the same team ID, this data is added to the same list 
20 (Step S25-5). On the other hand if the two players have different team IDs, 
or if there are no on-play flags, they will be managed under different lists 
(Step S25-6). The above-mentioned process is repeated until the last frame 
(Step S25-7) to create an appropriate list (Step S25-8). 

(b) TVpes of play lists 

25 (b 1) Overall game play list (Figure 26) 

The screen will change when the play list button is pressed during 
'Formation Analysis'. The screen will also change in if one of the team play 
data headings is selected and the play list button is pressed in 'Data 
Analysis'. The screen will show all plays, regardless of the sides to which 

30 plays belong. 
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(b2) Overall individual play list (Figure 27) 

As one heading from the individual play data in 'Data Analysis' is 
selected and the play list button is pressed, the screen will change. All 
plays, which the specified player took a part, will be listed. 

As previously mentioned, 'Formation Analysis' allows a graphic 
visualization of player movement, but it also contains other various 
functions to analyze the game from a tactical point of view. These tactical 
functions are contained in the 'Optional Operational Function Tools' located 
at the top of the screen. The 'Optional Operational Function Tools' will be 
explained below. 

9. Optional Operational Function Tools 

9a. Video playback tool <playback by list search> (Figures 28-36) 

While watching the formation analysis screen (animation), if the user 
wishes to watch an actual movement of the play, he can watch the actual 
image by pressing the 'Video playback tool' (Figure 28) button. By 
specifying a time, the videotape will be synchronized with the time code of 
the animation the to the designated time in order to display the actual game 
image (Figure 29) on the computer screen in a different window. 

Figure 30 is a flow chart of the operation of the video playback tool. 
First, by pressing the video playback button (Step S30-1), the actual frame 
number is verified (Step S30-2), and the same frame number is transmitted 
to the video player (Step S30-3). The appropriate image is displayed on the 
video window (Step S30-4) and the VTR of the same frame is played (Step 
S30-5). Pressing the 'Video Playback Tool' button ends the operation (Step 
S30-6). 

While the video playback tool is activated, clicking again on the video 
playback tool while pressing the 'option' key, the camera angle list included 
in the initial setting will appear in the pull-down menu. The desired 
camera angle can be chosen from the pull-down menu (Figure 28). This 
function will accommodate when multi-angle sports broadcasting begins, and 
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when video materials recorded from multi dimensions become available. 
The coordination with the video enables an objective analysis and effective 
control of multi-angles. 

Figures 29-36 show examples of angle specifications. Figure 29 
5 shows the 'Bird's eye view (main analysis image)' angle taken by camera 1. 
Figure 31 shows the 'stand opposite the goal' angle taken by camera 2. 
Figure 32 shows the 'goal front' angle taken by camera 3. Figure 33 shows 
the left main stand' angle taken by camera 4. Figure 34 shows the 'ground 
<mobile camera>' angle taken by camera 5. Figure 35 shows the 'behind the 
- 3 1 0 goal net' angle taken by camera 6. Figure 36 shows the 'corner' angle taken 

kU by camera 7. 

t* 

;_g The present invention is also constructed in order to accommodate 

for the prevalence of digital technology in the future, where sport games will 
be recorded from over 20 cameras to create a multi-angle recording. In 
15 addition to the overall bird-eye view, images simultaneously recorded from 
various angles will be used and synchronized with the game analysis by time 
code. 

9b. Chalking tool (Figures 10, 37, and 38) 

The chalking tool provides an effective tool at meetings where 
20 lectures on formations are given. By pressing the chalking tool button that 
looks like a pencil, the formation CG image will pause, the cursor will 
become a pencil shape, and can be used to freely make marks on the screen. 
This enables a detailed lecture on each situation. 

Figure 38 shows the operation of the chalking tool. First, when the 
25 chalking tool button is pressed (Step S38-1), the formation analysis screen 
(animation) pauses (Step S38-2). A new transparent layer is created (Step 
S38-3), and the pen tool is activated (Step S38-4). Pressing the chalking 
tool button again ends the operation (Step S38-5). 
9c. Subject player change tool (Figures 10, 39 and 40) 
30 Formation analysis will be based on over all players' movement. 
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However, for example, if the user likes to analyze the offensive (forward) 
movement of the user's own team intensively, the subject player change tool 
can be used. The players who are currently not the subject of analysis are 
located inside the yellow circles 39a and 39b in Figure 39. To change the 
players and activate them, they can be dragged onto the field. On the other 
hand, to deactivate currently active players, they can be dragged out from 
the field. This enables a more focused analysis. 

Figure 40 shows the operation of the subject player change tool. 
First, the subject player change tool button is pressed (Step S40-1), and the 
f 5 10 subject players are clicked and dragged (Step S40-2). If the player to be 
changed is now active, the icon coordinates become either x>120 or x<0 (Step 
S40-3) by dragging the player, and he becomes deactivated (Step S40-4). On 
the contrary, if the player to be changed is now deactivated, the icon 
coordinates becomes 0<x<120 (Step S40-5) by dragging the player, and he 
becomes activated (Step S40-6). Pressing the subject player change button 
3 is again ends the operation (Step S40-7). 

£ 9d. Magnifying glass tool for enlargements and reductions (Figures 10, 

* 41, and 42) 

If during data analysis, the area in front of the goal needs to be 
20 intensively analyzed as shown in Figure 41, the magnifying glass tool can be 
used to enlarge that part of screen. By clicking the magnifying glass on the 
field, the area around the cursor in the image will be enlarged to two times 
the original size. To reduce the image, the 'option' key is pressed to change 
the magnifying glass to a minus sign. By clicking on it while holding down 
25 the 'option' key, the image will reduce to 50%. Pressing the tool icon again 
will deactivate the enlargement and reduction function to bring the image 
back to its original size. The enlargement of the desired sections allows an 
effective analysis of specified zones. 

Figure 42 shows the operation of the magnifying glass tool for 
enlargements and reductions. First, the magnifying glass tool button is 
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pressed (Step S42-1) and the desired section on the screen is clicked (Step 
S42-2). The clicked point is calculated (Step S42-3) and the area around the 
cursor in the image will be enlarged to two times the original size (Step S42- 
4). Pressing the button while holding down the 'option' key will reduce the 
image to 50% of the enlarged size (Step S42-6). Pressing the magnifying 
glass tool again (Step S42-7) will bring the image back to its original size, 
ending the process. 

9e. Field block display tool (Figures 10, 43 and 44) 

The field block display tool can be used to divide the field into blocks 
and display an enlarged image. Clicking the tool icon will show the division 
patterns as shown in Figure 43, and the desired zones of analysis can be 
clicked to mask all other areas. More than one section can be selected so 
that, as an example, all three blocks on the right side can be selected. This 
enables an effective analysis of a narrowed zone on the play fields 

Figure 44 shows the operation of the block display tool. First, the 
block display tool button is pressed (Step S44-1) to display the blocks on the 
screen (Step S44-2). Next, the subject area is selected (Step S44-3) and all 
other areas are masked (Step S44-4). Pressing the block display tool button 
again (Step S44-5) ends the process. 

9f. Color-coding tool for players by position (Figures 10, 45 and 46) 

Normally, in sports like soccer, the players are assigned to a 
particular position. But often, these positions are interchanged or players 
cover for unusual areas depending on the flow of the game, making rapid 
changes like these, a part of the game. The color-coding tool enables a color 
visualization of player movements by positions, cover situations, and the 
forward and backward movements of formation lines. For example, as 
shown in Figure 45, the defense (DF), mid-fielder (MF) and forward (FW) 
player can each be color-coded. This results in the segmentation of the 
players and their positions, enabling an analysis with a focus on strategic 
points of the formation analysis, such as the interchange of marking and 
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coverage. 

Figure 46 shows the operation of the color-coding tool for players by 
position. First, the color-coding tool button is pressed (Step S46-1), and 
both the team ID and position data for each player is verified (Step S46-2). 
5 A team will be color-coded according to positions using different shades of a 
color (Step S46-3). Pressing the color-coding tool button again (Step S46-4) 
ends the process. 

9g. Viewpoint change tool (Figures 10, 47 and 48) 

Viewpoints can be selected to display images from different points of 
10 view, so that for example, the analysis image will not only be a general view 
from above the ground, but can also be from the back stand, behind the goal, 
and corner area, as shown in Figure 47. The viewpoint can be changed 
during analysis, by clicking on the viewpoint change tool icon to access the. 
pull- down menu where the viewpoint can be re-selected. Further, by 
M 15 making the analysis image into three dimensional, a virtual space can be 
3 created in which different angles can be specified. The change of viewpoints 

allows a more detailed analysis of formation. 

Figure 48 shows the operation of the viewpoint change tool. First, 
when the viewpoint change tool button is pressed (Step S48-1), the x, y and z 
20 coordinates for each player are verified (Step S48-2) and each player's 
coordinates are translated to accommodate the new viewpoint (Step S48-3). 
The image is re-produced (Step S48-4) based on the new values of the 
coordinates. Pressing on the viewpoint change tool button again (Step S48- 
5) ends the process. 

25 9h. OL display tool of player movements by activity area (Figures 10, 49 
and 50) 

As shown in Figure 49, the movements of 'the two players before and 
after replacement' can be overlapped and displayed to analyze the activity 
areas of each player. By comparing the activity areas of the original player 
30 and the replacing player, the conformity as well as a comparison of the 
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strong areas of each player's becomes possible. 

Figure 50 shows the operation of the player movement comparison 
OL display tool. First, the player movement comparison tool button is 
pressed (Step S50-1) and the players change is verified (Step S50-2). Next, 
the x, y and z coordinates of the subject player are verified (Step S50-3), and 
lines are drawn on the screen in order of frame advancement (Step S50-4). 
Pressing the player movement OL comparison display tool button again 
(Step S50-5) ends the process. 

9i. Tool to translate the play into numeric values (Figures 10, 51 and 52) 

This tool enables the evaluation of plays by numeric values (Figure 
51). Specifically, in a situation where the player passes the defense line by 
dribbling, showing factors like dribble speed and defense position in numeric 
values allows a more objective evaluation of whether the play has been 
reasonable, or the play could have been blocked. It is also possible to 
display an objective overall evaluation of the player in a given game by 
double clicking on the player icon (blue and red circles with numbers) after 
the play translation tool is activated. This enables an objective evaluation 
of the plays by each player. Further, a general, objective evaluation of each 
player in a given game becomes possible by calculating the total of the 
numeric values of the plays for each player. 

Figure 52 shows the operation of the tool. First, the play 
transformation tool button is pressed (Step S52-1) and the subject player is 
selected (Step S52-2). A cover man is chosen through the coordinates of the 
player (Step S52-3), and the movement speed of the opponent player is 
calculated (Step S52-4). This is compared to the basic judging data created 
from past data (Step S52-5) and a numeric value is produced as a result 
(Step S52-6). Steps S52-4 to S52-G are repeated for each play. Pressing 
the tool button again (Step S52-7) ends the operation. 
9j. Open space display tool (Figures 10, 53 and 54) 

In soccer, it becomes strategically very important for the offense to 
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create and widen a space where there is no player (open space), and to have 
the offense player run into this space in order to take an advantage, as 
shown in Figure 53. The open space display tool allows a constant graphic 
display of the open space where the players are not crowded during space 
creation analysis. Consequently, the initiation of the offensive is made 
clear. 

Figure 54 shows the operation of the open space display tool. First, 
the open space display tool button is pressed (Step S54-1) to identify the 
team ID of the player in possession of the ball (Step S54-2). The defense 
player on the opponent team's goal side is identified (Step S54-3) and a 
figure connecting the x and y coordinates, as well as a 10 meter radius circle 
with the x and y coordinates as its center (in the scale of the field) are made 
(Step S54-4). Preparation to designate the area in the opponent goal side 
(0<x<60, 0<y<80) or (60<x<120, 0<y<80) is made (Step S54-5) and the goal 
side area and produced figure area are displayed (Step S54-6). Pressing on 
the open space display tool button again (Step S54-7) ends the operation. 
9k. Rearmost line advancement display tool (Figures 10, 55 and 56) 

In soccer, when the distance between the foremost fine of offense and 
the rearmost line of defense is kept short, the team is generally considered to 
have good formation. The rearmost line advancement display tool shows 
the spread area between the foremost and rearmost lines by shading, as 
shown in Figure 55. This enables a clear visualization of the extent to 
which compact soccer is achieved by seeing the overall formation. 

Figure 56 shows the operation of the rearmost line advancement tool. 
First, the advancement tool button is pressed (Step S56-1) and the team is 
selected (Step S56-2). The x coordinates of all the players in the selected 
team are verified (Step S56-3) and the maximum and minimum values of the 
x coordinate are chosen (Step S56-4). The area between the four points 
(minimum value for x, y=0)/(minimum value for x, y=80)/(maximum value for 
x, y=0)/(maximum value for x, y=80) is shaded (Step S56-5). Steps S3 to S5 
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are repeated for each frame. Pressing on the rearmost line advancement 
tool button again (Step S56-6) ends the operation. 
91. Player movement track display tool (Figures 10, 57 and 58) 

The player to be traced can be selected by pressing the tool button. 
5 As pressing the tool button, the icons of all players start flashing, and the 
movie playback pauses. The flashing stops when the player is selected. The 
track of the player's movement appears on the screen as shown in Figure 57. 
In this example, the color of the arrow is the same color that was selected in 
formation analysis. It becomes possible to visually analyze the play of each 
10 player. 

Figure 58 shows the operation of the player movement track display 
tool. First, the track tool button is pressed (Step S58-1), and the player is 
selected (Step S58-2). The current number of frame is verified (Step S58-3), 
and the coordinates for the 50 frames just before, which is the equivalent of 
15 five seconds, are drawn as a line according to the order of the frame (Step 
.S58-4). The coordinates points prior to the 50 frames just before are erased 
(Step S58-5). Steps S58-3 to S58-5 are repeated for each frame (Step S58-6). 
Pressing on the tool button again (Step S58-7) ends the operation. 
9m. Positional relationship display tool (Figures 10, 59 and 60) 
20 In soccer, the effective interchanges of positions and positioning 

among players are important tactics. This tool joins the two selected 
players by a line or a figure that forms more than two players to illustrate 
the lengths and size of the lines and figures in real time. Consequently, the 
understandings of the mobility between players and game plans are clearly 
25 improved. 

Figure 60 shows the operation of the positional relationship display 
tool. First, the relationship tool button is clicked (Step S60-1), and the 
subject players are selected (Step S60-2). The x and y coordinates of the 
selected player are verified (Step S60-3), and a multi-sided figure containing 
30 the corresponding number of images to the number of selected players is 
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drawn (Step S60-4). Steps S60-3 to S60-4 are repeated for each frame. 
Pressing the relationship tool button again (Step S60-5) ends the operation. 
9n. Direction vector display tool (Figures 10, 61 and 62) 

This tool determines the direction of movement in the next frame of 
5 the coordinate data obtained by the automatic tracking device and uses the 
difference between coordinates from the previous frame in order to 
determine the direction. Triangles, showing the player's direction derived 
as a result, can additionally be displayed for the selected player 
simultaneously (Figure 61). This enables the display of individual player's 

10 direction through an easy, flat player icon. 

Figure 62 shows the operation of the direction vector display tool. 
First, the direction vector display tool button is pressed (Step S62-1), and the 
subject player is selected (Step S62-2). The selected player's current 
coordinates are verified (Step S62-3) and the player's coordinates one frame 

15 ahead are verified (Step S62-4). The difference between the current 
coordinates and the coordinates for the next frame is calculated (Step S62-5) 
and a triangle with its peak pointing the direction of movement is drawn 
(Step S62-6). Steps S62-4 to S62-6 are repeated for each frame. Pressing 
on the tool button again (Step S62-7) ends the operation. 

20 In the following, 'Data Analysis' 202 (See Figure 2) will be explained 

with reference to Figures 63 to 104. 

As shown in Figure 63, the headings 'Jo/Nakata/Japan National 
Team/Clear search results' 4001 appears on the top of screen followed by 
Multiple selection possible' 4002, 'Search results' 4003, 'Subject of analysis' 

25 4004, 'Addition' 4005, 'All' 4006, 'Start individual analysis' 4007, 'Start team 
analysis' 4008, and 'Return' 4009. 

In this example, the following appeared for heading 'Search Results' 
4003 as seen in Figure 6. 

30 2/5 Japan National Team vs. Korea National Team Clear 
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Croatian National Team Clear 

Brazil National Team Clear 

Paraguay National Team Clear 

Macao National Team Clear 

UAE National Team Clear 

Korea National Team Clear 

China National Team Clear 

Argentina National Team Clear 
Saudi Arabia National Team Clear 



Multiple games are selected as subjects of analysis from the match 
list in 'Data analysis'. In this example, the headings '2/5 Japan National 
Team vs. Korea National Team Clear, 3/8 Japan National Team vs. Croatia 
National Team Clear, 3/12 Japan National Team vs. Brazil National Team 
Clear' are clicked. The corresponding section shows the 'Subject of Analysis' 
4004 as subject headings 4010; 

2/5 Japan National Team vs. Korea National Team Clear 
3/8 Japan National Team vs. Croatian National Team Clear 
3/12 Japan National Team vs. Brazil National Team Clear 



When 'Start Individual Analysis' 4007 is clicked, the user proceeds to 
the 'Individual Data Analysis Subject Player Selection Menu' 5000 screen as 
shown in Figure 64. (see details later) Similarly, by clicking the 'Start 
Team Analysis' 4008 of Figure 63, the user proceeds to the 'Team Data 
Analysis Subject Selection Menu' 6000 screen as shown in Figure 65. (See 
details later) Clicking on 'Return' 4009, will bring the user back to the 
analysis subject search sub-menu of Figure 63. 

First, 'Individual Analysis' of 'Data Analysis' will be explained. 

When 'Start Individual Analysis' 4007 in Figure 63 is clicked, the 
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Individual Data Analysis Subject Player Selection Menu' 5000, like that 
shown in Figure 64, appears on the display 50 of Figure 1. The subject 
game is selected from the 'Search Results' 5001 shown at the top of Figure 64. 
The players participating in the particular game appear under Tlayer List' 
5 5002. The following is a part of the list shown in Figure 64. By scrolling 
down on the scroll key to the right of 5002 in Figure 64, alternate players can 
be selected. 





20. 


Kawaguchi 


20. 


. Suker 


U io 

*..u 


17. 


Akita 


10. 


. Boban 


4. 


Ihara 


11. 


Bilic 


In 


16. 


Saito 


8. 


Boksic 




19. 


Nakamura . 


10. 


. Simic 




7. 


Honda 


5. 


Prosinecki 


1* 15 


8.. 


Nakata 


15. 


. Marie 



C3 
S-3 

;t After one player is selected from the Tlayer List' 5002 above, the 

1* 'Enter' button 5003 is clicked. The 'Detailed Play Analysis' screen 

(explanation to follow) of the selected player in a given game will appear. 
20 The user can return to (1) 'Data Analysis Top Menu' 5004 and (2) 'Analysis 
Subject Search Sub-menu' 5005 from the Individual Data Analysis Subject 
Player Selection Menu' 5000. 

In the following, each 'Detailed Play Analysis' screens will be 
described. 

25 11a. Individual Data <Field Player> (Figures 64 and 66) 

When the field player (player) is selected from the Individual Data 
Analysis Subject Selection Menu' (Figure 64), the user can see a list of 
detailed numeric data regarding the subject player, such as the numbers of 
goals and fouls in the subject game. 

30 Figure 66 shows a case where 'Nakata' is the selected as a field 
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player. In Figure 66, 'pass', 'shoot', 'foul', 'card', 'card obtained' and 'athletic 
ability' in the three games Vs. Croatia', Vs. Korea', 'vs. Brazil' appear under 
'Nakata's personal data chart'. By clicking the number under 'pass' in the 
Vs. Croatia' game for example in Figure 66, 
5 'Nakata's individual play data chart <pass>' (explanation to follow) screen 
appears as shown in Figure 67. 

Further, by clicking the 'Detailed Data' 6001 to 6003 shown to the 
right in Figure 66, the user proceeds to the Individual Related Detailed Data 
Menu' (will be described below) where play data obtained from the play 

£3 io analysis of the corresponding games is shown as graphs/diagrams. 

t,B lib. Individual Play Data (Figure 64 and 67) 

[q When the number under 'total number' in 'passes' is clicked for 

^ 'Individual data <Nakata>' in the game 'vs. Croatia' in Figure 66, the 

^ 'Individual Play Data' screen appears as shown in Figure 67. Here, the 

M 15 details of player 'Nakata's' pass play in the 'vs. Croatia' game can be seen. 

13 

□ The same can be done for 'shot', and 'foul', etc. 

X The headings, 'time', which shows the time that the pass was made, 

H 'passed to', which gives the name of the player who the pass was made to, 

'kicking foot' during pass, 'speed', 'distance' and 'direction' are listed as 
20 shown in Figure 67. 

One pass play is selected from the list in Figure 67. By clicking the 
'play list' 7001 the user proceeds to the play list pertaining to the 'Formation 
Analysis' mentioned above. (See Figures 26 and 27) 
12. Team Data (Figure 68) 
25 'Data<J Team>' under 'Team Data' shown in Figure 68 shows a 

detailed the numeric data list of all of 'passes', 'shots', 'fouls', 'cards', 
'acquired cards', 'athletic ability', 'ball touch', 'dribble distance', 'off-side', 'FK 
(Free kicks)', 'CK (Corner kicks)', 'top to bottom', 'opponent area invasion 
rate' (figure omitted), loose ball acquisition rate' (figure omitted) and 'ball 
30 control rate' (figure omitted), in a given game of the Japan National Team (J 
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Team) when it is selected from the Team Data Analysis Subject Selection 
Menu' in Figure 65. 

By clicking the total number under 'passes', 'shoots' and 'fouls' of 
each game, the user can proceed to Team Play Data' where a detailed list of 
game contents can be seen such as the time period during which each play 
took place. 

Figure 69 shows an example of Team Play Data <passes>\ which is 
the Team Play Data' for 'passes'. 

By clicking the 'Detailed Data' (8001 to 8003) button to the right in 
Figure 68, the user can proceed to the 'Detailed Team Data Menu' screen 
(explanation to follow) where the plays in each game are analyzed and 
designed into graphs and charts. Further, clicking on the 'Return to data 
analysis top menu' heading will bring the user back to the 'Data Analysis Top 
Menu' shown iri Figure 63. 

Next the aforementioned 'Detailed Individual Data' will be 
explained. 

12. Detailed Individual Data Menu 

As shown in Figure 70, 'Individual Data' has menus (icon) 7001 to 7003 that 
can bring up the 'Detailed Individual Data' for each game. By clicking the 
icons 7001 to 7003, the title list (menu) of all obtainable 'Detailed Individual 
Data' for the selected game appears on the screen of the image display device 
50 from the memory device 23 of the automatic tracking device 20 through 
the interface 30 shown in Figure 1. 

The 'Detailed Individual Data' outlined in Figure 71 basically 
generates data as figures and graphs, and includes data like 'shoot track', 
'change of movement speed', 'change of movement distance per unit of time', 
'comparison of activity area between the two halves', and 'ball pass route'. 
Since 'Detailed Individual Data' should be displayed as a graph, there is no 
further links. 

12a. Individual Related Data - Shoot Track (Figure 72) 
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As the 'shoot track of the individual' is selected from the Individual 
Related Data' screen during 'Individual Data' analysis, the (1) total shoot 
number and (2) the track of each shoot appear as figures on the screen of the 
image display device 50 from the memory device 23 of the automatic tracking 
5 device 20 through the interface 30 as shown in Figure 1. 

Figure 72 visually illustrates the shoot tracks of the three shots that 
'Nakata' made in the March 8 Vs. Croatia' game. 

Figure 73 shows the operation of the shoot track tool of the individual. 
First, the shoot track selection button is pressed (Step S73-1) and the s play 
£5 10 flag of the selected player is verified (Step S73-2). The number of s flags are 
3 counted and reflected in the total shoot number (Step S73-3) and the x, y and 

! q z coordinates of the ball beyond the s flag are drawn with a line (Step S73-4). 

];? Pressing on the 'return' button (Step S73-5) will bring the user back to the 

* 3 'Detailed individual data menu'. 

U 15 12b. Individual Related Data - Change of Moving Speed (Figure 74) 

As the 'change of moving speed of individual player in a game' is 
selected from the Individual Related Data' screen during Individual Data' 
analysis, the (1) average moving speed and (2) speed, calculated from the 
time axis, appear as figures on the screen of the image display device 50 from 
20 the memory device 23 of the automatic tracking device 20 through the 
interface 30 as shown in Figure 1. 

Figure 74 shows the moving speed of TNfakata' in the March 8 Vs. 
Croatia' game where time is the parameter on the horizontal axis. 
According to the graph, his overall speed decreases towards the later part of 
25 the first half of the game, and shows that he is not moving very much on the 
field until he gets involved in scoring plays. 

Figure 75 shows the operation of the change of moving speed tool. 
First, the change of moving speed button is pressed (Step S75-1), and the x 
and y coordinates of the selected player are verified (Step S75-2). The 
30 change of speed for every 30 frames is calculated (Step S75-3) and the graph 
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of the calculated moving speed is generated (Step S75-4). Pressing the 
'return' button (Step S75-5) will bring the user back to the detailed 
individual data menu. 

12c. Individual Related Data - Change of Moving Distance Per Unit of Time 
5 (Figure 76) 

As the 'change of moving distance per unit of time for a player within 
a game' is selected from the Individual Related Data' screen during 
Individual Data' analysis, the (1) total moving distance and (2) moving 
distance per unit of time appear as a graph on the screen of the image 
G io display device 50 from the memory device 23 of the automatic tracking 
< Q device 20 through the interface 30 as shown in Figure 1. 

JfJ Figure 76 shows that 'Nakata' moved a total of 2580 meters during 

j;g the March 8 Vs. Croatia' game, and that his change in moving distance per 

**B unit of time was stable except towards the later part of the second half. 

|:£ is Figure 77 shows the operation of the individual change of moving 

distance tool. First, the individual change of moving distance button is 

% pressed (Step S77-1), and the x and y coordinates of the selected player are 

Q 

H verified (Step S77-2). The moving distance is calculated for each frame 

(Step S77-3), the result is divided into blocks of distance per minute (Step 
20 S77-4) and the moving distance is illustrated (Step S77-5). Pressing the 
'return' button (Step S77-6) will bring the user back to the detailed 
individual data menu. 

12d. Individual Related Data - Comparison of Activity Area in the Each 
Half (Figure 78) 

25 As 'comparison of activity area in the two halves' is selected from the 

'individual related data' during 'Individual Data' analysis, the (1) movement 
distance during each half and the (2) comparison of movement distance 
between two halves appear as figures on the screen of the image display 
device 50 from the memory device 23 of the automatic tracking device 20 

30 through the interface 30 as shown in Figure 1. 
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Figure 78 shows that 'Nakata' moved a total of 1852 meters in the 
first half and 1735 meters in the second half of the March 8 Vs. Croatia' 
game and the activity areas during each half is illustrated as tracks. 

Figure 79 shows the operation of the activity area comparison tool. 
First, the activity area comparison button is pressed (Step S79-1), and the x, 
y and z coordinates of the selected player are verified (Step S79-2). Lines 
are drawn in order of frame advancement for each half (Step S79-3) and the 
total moving distance is calculated for each half (Step S79-4). Pressing the 
'return' button (Step S79-5) will bring the user back to the detailed 
individual data menu. 

12e. Individual Related Data - Individual Pass Route Diagram (Figure 80) 

As 'activity area comparison' is selected from the Individual Related 
Data' screen during Individual Data' analysis, the (1) total pass number per 
individual (to/from) and the (2) frequency of pass between individual players 
appear as diagrams on the screen of the image display device 50 from the 
memory device 23 of the automatic tracking device 20 through the interface 
30 as shown in Figure 1. 

Figure 80 shows the total pass number made by 'Nakata' during the 
March 8 Vs. Croatia' game. It shows that 'Nakata' received a total of 36 
passes and made a total of 35 passes. The top row in Figure 80 lists the 
players who TNFakata' received passes from and the bottom row lists those 
who £ Nakata' made passes to. The frequency of the passes between two 
players can be easily visualized from the thickness of the lines connecting 
'Nakata' and other players. It can be understood from Figure 80, that 
'Nakata' received more passes from 'Akita' and 'Soma' while he made more 
passes to 'Jo ? and 'Nakayama'. 

Figure 81 shows the operation of the individual pass route tool. 
First, the individual pass route button is pressed (Step S81-1), and play lists 
of all players are verified (Step S81-2). The numbers of times, that the ball 
is passed from the player with the pass flag before the trap flag of the 
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selected player, are verified and counted (Step S81-3). The player, who 
received the ball after the pass flag of the selected player, is verified and 
counted (Step S81-4). The lines are drawn according to the frequency at 
which the passes were made to and from the players (Step S81-5). Pressing 
5 the 'return' button (Step S81-6) will bring the user back to the detailed 
individual data menu. 

In the following, the Team Related Data' will be explained. 
13. Team related data menu (Figure 82) 

Icons 800 1 to 8003 are arranged to move to the Team Related Data' 
P 10 for each game under the Team data' heading. The obtainable title list of 
* : 2 the Team Related Data' will appear on the screen of the image display device 

[q 50 from the memory device 23 of the automatic tracking device 20 through 

J;5 the interface 30 when the icons 8001 to 8003 are clicked. From this list, 

^ B data can be selected, and its contents will be available. The Team Related 

U 15 Data' basically generates graphs and figures of data just as the Individual 
i«3 Related Data'. As shown in Figure 83, it includes figures such as 'zone 

t distribution of committed fouls', e shoot side tendency', 'shoot track', /shot 

U 

M distance tendency', 'change of width between the top and bottom fines in 

defense', 'offense/defense tendency over time', 'change of ball control rate', 
20 'comparison of ball control rates by area', 'ball rotation route in offense' and 
'pass route line diagrams'. No further links exist since 'Detailed Team Data' 
is shown as graphs. 

13a. Team Related Data - the Zone Distribution of Committed Fouls 
(Figure 84) 

25 As the 'zone distribution of fouls committed by a team' is selected 

from the Team related data' screen during Team data' analysis, the (1) total 
number of fouls and the (2) zones, in which the fouls were committed along 
the time axis, appear on the screen of the image display device 50 from the 
memory device 23 of the automatic tracking device 20 through the interface 

30 30 as shown in Figure 1. 
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Figure 84 shows that there were many fouls committed after 
entering the opponent's zone during the first half of the March 8 Vs. Croatia' 
game, and in the second half, fouls were committed at the same rate in both 
opponent's and own zones. Further, it is evident that the opponent team 
scores points after fouls have been committed in the opponent's zone. 

Figure 85 shows the operation of the zone distribution of committed 
fouls tool. First, the foul area button is pressed (Step S85-1), and the foul 
flag is verified (Step S85-2). The x coordinates and frame numbers of the 
players, when the flags go up, is reflected (Step S85-3). Pressing the 
'Return' button (Step S85-4) brings the user back to the detailed team data 
menu. 

13b. Team Related Data - Shoot Side Tendency (Figure 86) 

As 'shoot side tendency of the team over time' is selected from the 
Team Related Data' screen during Team Data' analysis, the (1) total number 
of shoot and the (2) angle of the shoot along the time axis appear as a figure 
on the screen of the image display device 50 from the memory device 23 of 
the automatic tracking device 20 through the interface 30 as shown in Figure 
1. 

Figure 86 shows that there were more shoots from the right side in 
the first half of the March 8 Vs. Croatia' game. Then, some shoots were 
made from the side attack in the second half, and however, more shots were 
made from the center towards the end of the game. 

Figure 87 shows the operation of the tendency of the team shoot side 
tendency tool. First, the shoot side tendency button is pressed (Step S87-1), 
and shoot flags of all players are verified (Step S87-2). The y 
coordinate/frame number of the ball when the flags go up are reflected (Step 
S87-3). Pressing the 'return* button (Step S87-4) will bring the user back to 
the detailed team data menu. 

13c. Team Related Data Shoot Track Line Diagram (Figure 88) 

As 'shoot path line diagram' is selected from the Team Related Data' 
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screen during Team Data' analysis, the (1) total number of shoot and the (2) 
track of the ball along the time axis appear on the screen of the image 
display device 50 from the memory device 23 of the automatic tracking 
device 20 through the interface 30 as shown in Figure 1. 

Figure 88 shows the each shoot track of player numbers 8, 11, 19 and 
22 in the March 8 Vs. Croatia' game. It becomes evident that the shoot 
made by player 8 from the penalty area to the right by makes the goal. 
Further, it can be understood that the shoot made by player number 19 has 
passed above the goal. 

Figure 89 shows the operation of the team shoot track line diagram. 
First, the shoot track diagram button is pressed (Step S89-1) and the s play 
flags of all players are verified (Step S89-2). The total number of s flags are 
counted and reflected in the total number of shoot (Step S89-3), and the x 
and y coordinates of the ball beyond the s flag are drawn as lines (Step S89- 
4). Pressing the 'return' button (Step S89-5) will bring the user back to the 
detailed team data menu. 

13d. Team Related Data - Shoot Distance Tendency (Figure 90) 

As 'tendency of shoot distance over time' is selected from the Team 
Related Data' screen during Team Data' analysis, the (1) average shoot 
distance and the (2) shoot distance over time appear on the screen of the 
image display device 50 from the memory device 23 of the automatic tracking 
device 20 through the interface 30 as shown in Figure 1. 

Figure 90 shows that shoots have been made from an average 
distance of 40 meters from the goal directed towards the center, in the first 
half of the March 8 Vs. Croatia' game, but in the second half, more shoots 
were made from a distance of 25 to 30 meters. In other words, this 
illustrates the fact that shots could not be made from near the goal. 
Further, it becomes the evident that the average shot distance was 28.2 
meters. 

Figure 91 shows the operation of the team shoot distance tendency 
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tool. First, the shoot distance tendency button is pressed (Step S91-1) and 
the shoot flags of all players are verified (Step S91-2). The x 
coordinates/frame number of the ball, when the flags go up, are reflected in 
the graph (Step S91-3). Pressing the 'return 5 button (Step S91-4) will bring 
the user back to the detailed team data menu. 

13e. Team Related Data - Change of Distance Between the Top and Bottom 
Lines of Defense (Figure 92) 

As the 'change of distance between the top and bottom lines of 
defense* is selected from the Team Related Data' screen during 'Team Data' 
analysis, the (1) average distance between top and bottom lines and the (2) 
distance between the top and bottom lines during defense over time appear 
on the screen of the image display device 50 from the memory device 23 of 
the automatic tracking device 20 through the interface 30 as shown in Figure 
1. 

Figure 92 shows that the distance between the top and bottom lines 
was below 20 meters when point was scored in the March 8 Vs. Croatia' 
game. But when the opponent team scored, this distance had increased to 
approximately 25 meters, and spreads to about 30 meters after the score by 
opponent. This means not only making difficult to defend by disabling to 
set up an offside trap, but also providing the opponent more opportunities to 
attack. 

Figure 93 shows the operation of the distance between the top and 
bottom lines of defense. First, the distance between top and bottom is 
pressed (Step S93-1), and the x coordinates of all players of the selected team 
are verified (Step S93-2). The maximum and minimum values of the x 
coordinates are chosen (Step S93-3), and the (maximum/minimum) values of 
the x coordinates are calculated for each frame to draw a graph (Step S93-4). 
Pressing the 'return' button (Step S93-5) will bring the user back to the 
detailed team data menu. 

13f. Team Related Data - Defense/ Offense Tendency (Figure 94) 
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As 'defense/offense tendency of a team over time' is selected from the 
Team related data' screen during Team data' analysis, the (1) play ratio in 
opponent's zone and the (2) ball movement track over time <movement right 
afterwards> appear on the screen of the image display device 50 from the 
5 memory device 23 of the automatic tracking device 20 through the interface 
30 as shown in Figure 1: 

Figure 94 clearly shows the details in defense/offense of the Japan 
National Team from kick off to time up in the March 8 Vs. Croatia' game. 
There are big offensive periods in each the first and second half, but it is 
□ 10 evident that overall, the team was in defense more time during the game. 
t .g Figure 95 shows the operation of the defense/offense tendency tool. 

First, the team defense/offense tendency button is pressed (Step S95-1) and 
the x coordinates of the ball are verified (Step S95-2) to draw a line for each 
frame (Step S95-3). Pressing the 'return' button (Step S95-4) will bring the 

Si 

|:£ 15 user back to the detailed team data menu. 

l-3g. Team Related Data - Ball Control Rate Change (Figure 96) 
:;P As 'change of ball control rate over time' is selected from the Team 

: 

1=4 related data* screen during Team data' analysis, the (1) ball control rate and 

the (2) change of ball control rate over time appear on the screen of the image 

20 display device 50 from the memory device 23 of the automatic tracking 
device 20 through the interface 30 as shown in Figure 1. 

Figure 96 shows that the ball control rate was 38% in the March 8 Vs. 
Croatia' game, and that this rate is especially low towards the end of the first 
half to the beginning of the second half. 

25 Figure 97 shows the operation of the team ball control rate tool. 

First, the ball control rate button is pressed (Step S97-1) and the ball touch 
flags of all players are verified (Step S97-2). The ratio of ball touch flags is 
calculated for both teams in one-minute units (Step S97-3) and this flag ratio 
is drawn as a graph (Step S97-4). Pressing the 'return' button (Step S97-5) 

30 will bring the user back to the detailed team data menu. 



45 



13h. Team Related Data - Ball Control Rate by Zone (Figure 98) 

As 'ball control rate by zone' is selected from the Team related data' 
screen during Team data' analysis, the (1) ratio of play area and the (2) ball 
control rate of both teams by zone appear on the screen of the image display 
device 50 from the memory device 23 of the automatic tracking device 20 
through the interface 30 as shown in Figure 1. 

Figure 98 shows the ball control rate for each zone (A to D) in the 
March 8 Vs. Croatia' game. 

Figure 99 shows the operation of the ball control rate by zone tool. 
First, the ball control rate by zone button is pressed (Step S99-1) and the x 
and y coordinates when the ball touch flags for all players go up are verified 
(Step S99-2). The flags are divided into ball coordinates (x, y) = A zone 
(under 60, under 40), B zone (over 60, under 40), C zone (under 60, over 40) 
and D zone (over 60, over 40) respectively (Step S99-3). Then, the ball touch 
flag ratios per zone for both teams are calculated and reflected in a chart 
(Step S99-4). Pressing the 'return' button (Step S99-5) will bring the user 
back to the detailed team data menu. 

13i. Team Related Data - Ball Rotation Track During Offense (Figure 100) 

As 'ball rotation track during offense' is selected from the Team 
related data' screen during Team data' analysis, the (1) total number of 
passes and the (2) ball rotation tracks drawn by two different colors for each 
half appear on the screen of the image display device 50 from the memory 
device 23 of the automatic tracking device 20 through the interface 30 as 
shown in Figure 1. 

Figure 100 shows the ball rotation tracks of that the Japan National 
Team used in their offense in the March 8 Vs. Croatia' game. The figure 
clearly shows that during offense drawn by 'red' lines, the ball rotation took 
place over an evenly spread area, however, during offense drawn by 'yellow' 
lines, the ball was rotated more often in the lower right section. 

Figure 101 shows the operation of the ball rotation track during 
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offense. First, the ball rotation button is pressed (Step S 10 1- 1), and the ball 
touch flags of all players are verified (Step S101-2). The coordinates of the 
ball at the time the ball touch flags go up are verified and drawn as a line 
(Step S10 1-3). Pressing the 'return' button (Step S 10 1-4) will bring the user 
back to the detailed team data menu. 

13j. Team Related Data - Pass Route Lines (Figures 102, 103 and 104) 

When 'pass route lines' is selected from the Team related data' 

screen during Team data' analysis, the (1) total number of passes and the (2) 

frequency of passes between players appear as a figure on the screen of the 

image display device 50 from the memory device 23 of the automatic tracking 

device 20 through the interface 30 as shown in Figure 1. 

Figure 102 shows that pass route line diagram of the March 8 Vs. 

Croatia' game. It helps visualize the frequency of passes between players in 

the given game. 

Figure 103 shows the operation of the pass route line diagram tool. 
First, the pass route line diagram button is pressed (Step S 103-1) and the 
play lists of all players are verified (Step 103-2). The number of passes 
made from the player with the pass flag, before the trap flag of the selected 
player is counted and verified (Step S103-3). The player who received the 
ball after the pass flag of the selected player is counted and verified (Step 
S 103-4), and passes to and passes from each player is counted in order to 
draw the pass frequency line (Step S103-5). This process is repeated for all 
players (Step S103-6). Pressing the 'return' button (Step S103-7) will bring 
the user back to the detailed individual data menu. 

By clicking a specific player in the 'team pass route line diagram' 
shown in Figure 104, the player's individual 'pass route line diagram' 
appears on the screen of the image display device 50 from the memory device 
23 of the automatic tracking device 20 through the interface 30 as shown in 
Figure 1, which shows both passes received and sent out. Figure 104 shows 
the passes received and sent out for player 'Nakata' in the March 8 Vs. 
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Croatia' game. 

Next, other embodiments of the present invention are explained. 
These embodiments consist of the functions explained below added to 
the functions through above mentioned embodiments. 

1. The detail explanation for formation analysis tools. 

By clicking the tool button on the screen, the windows or tool boxes, 
where users can input the analysis object and condition, will appear on the 
screen. 

The function is decided by pressing the return button after the user 
set up each condition depending on the each tool on the screen. 
Also, by pressing the play back button of play control button, the operation of 
each function will be started. 

The operation is stopped when the user clicked the tool icon during 
the operation is active. 

For resetting the operation, the user can reset by clicking the tool box 
again after the user cancel the operation by clicking the tool button. 
1-1. Digital video set tool 

< Function > 

As shown in Figure 105, the user can control play back and copy 
operations through multiple recording digital video camera and playing 
digital video cameras by "play control button" 105a- 105c and/or "video edit 
recording button" 105d after selecting this digital video set tool. 
<Set up window > 

It is outputted in a window form on the formation analysis screen. 
After setting up each digital video camera, by clicking the return button the 
user enables to operate the play control button or the video edit recording 
button linking with video materials during the formation analysis. 
1-2. Field block display tool 

< Function > 
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By pressing this tool icon, the multiple block pattern 106a on the 
screen as shown in Figure 106. By clicking the desired analysis area in this 
block pattern, all area will be masked except the desired area. 

< Set up window > 

5 It is outputted in a window form on the formation analysis screen. 

The field divided into blocks is shown on the screen. As the user 
selects the check button(s) assigned to each block (multiple selection 
possible) and presses the return button, the masking 107a is reflected on the 
actual formation screen as shown in 107. 
□ 10 1-3. Player position color-coding tool 

< Function > 

As using this color-coding tool, the user can recognize "player's 
movement," "covering situation," or "commands of lines" for each position in 
kQ different colors. (Figure 108 and Figure 109) 

j.£ 15 < Set up window > 

|£ It is outputted in a window form on the formation analysis screen. 

The player icon for color preview is displays next to player's names. 
By selecting the subject player(s) icon and clicking subject color(s) on 
the color palette, the user can change the icon(s) color. 
20 1-4. Subject player change tool 

< Function > 

By using this subject player change tool, the user enables to analyze 
particular player intensively. For example, if the user likes to analyze 
forward position player(s) of own team intensively, all players except 
25 analysis subject player(s) can be put out of the field. (Figure 110) 
<Set up window > 

When the user starts up the tool, all players' icons are displayed out 
of the field. (110a and 110b) 

As clicking the player's icon out of the field, the clicked player is 
30 moved into the field and displayed with color-edged. (110c) Then, after the 
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user pressed playback button, only selected player(s) is(are) displayed on the 
actual formation analysis screen. 

For resetting the operation, the user can reset by clicking the tool box 
again after the user cancel the operation by clicking the tool button. 
1-5. Positional relationship display tool (triangle mode) 

< Function > 

As shown in Figure 111, the user can recognizes the space and 
movement between three players through drawing a figure connecting three 
players (llla-lllc) by using this positional relationship display tool. Three 
selected players are connected by lines, the triangle is shaped, and the zone 
between each the players is displayed as color-coded triangle. Through this 
composition, the user can analyze the positioning between the players 
visually. The user can also connect any desired players disregarding own or 
opponent team. 

< Set up window > 

By pressing the tool button, the formation analysis is paused. 

As clicking players' icons, the selected players become color-edged, 
and the selection is fixed. When the user clicks the play button, the 
relationship between the players is reflected in the formation analysis screen. 
(The selected players must be more than three players.) 

For resetting the operation, the user can reset by clicking the tool box 
again after the user cancel the operation by clicking the tool button. 
1-6. Direction vector display tool 

< Function > 

As shown in Figure 112, by using this advancement vector tool the 
player's movement direction is displayed through the determination of 
differences between present flame and next frame of the coordinate data 
obtained from the automatic following device. (112a) The display form is 
that triangles are added to the selected players' icons. 
<Set up window > 
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The formation analysis is paused once when the user clicked the tool 

button. 

As clicking player's icon, the selection of player is fixed by color- 
edged. The player's moving direction is displayed on the formation analysis 
5 screen reflecting the actual player's movement after clicking the play back 
button. 

For resetting the operation, the user can reset by clicking the tool box 
again after the user cancel the operation by clicking the tool button. 
1-7. Referee tool 
□ 10 < Function > 

,S As shown in Figure 113, each official's evaluation at games can be 

done by following the movement of referee (113a) and assistant referees 
(113b and 113c) during games. Also, this tool can be used for- training- of 

m 

* r Q officials. For example, it can be analyzed whether referee is moving 

15 diagonally on the field, and whether each assistant referee is moving with 
J;5 offside fines. 

< Set up window > 
By clicking the tool button, the formation analysis is paused once, 

and the referee icon is displayed. As the play back button is clicked, the 
20 actual referees' movements reflect on the formation analysis screen. 

For resetting the operation, the user can reset by clicking the tool box 
again after the user cancel the operation by clicking the tool button. 

2. Player data analysis and related data analysis 
25 2-1. Pass route diagram 

< Function > 

Figure 114 is a diagram, which shows pass routes of a player and 
displays where the player passed to during games. Mainly, positioning of 
players, pass tendency at each position, tendency of centering direction of 
30 side back or wing back, and tendency of field direction of goal keeper can be 
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analyzed. 

<Set up window > 

The selected player's pass route diagram is displayed by clicking the 
return button after the user selected the subject player for analysis in the 
window. 

3. Team data analysis and related data analysis 
3-1. Referee's activity diagram for each half 

< Function > 

Figure 115 is a diagram which displays the referee's activity in each 
half by sampling the activity for particular fixed time (several seconds). A 
diagonal movement to the field is desirable for referee's activity since it 
covers sides where each assistant referee is not existent. By using this 
diagram, the desirable activity can be checked. 

< Set up window > 

By the user clicks the tool button, the formation analysis is paused, 
and the referee icon is displayed. As the play back button is clicked, the 
actual referees' movements reflect on the formation analysis screen. 
For resetting the operation, the user can reset by clicking the tool box again 
after the user cancel the operation by clicking the tool button. 

4. Play list 

< Function > 

As shown in Figure 116, the play list displays all plays during a game. 
By clicking the play number, the user can do the formation analysis (2D 
animation) for the situation where the particular play occurs, the player data 
analysis, or the team data analysis for the game. 

For example, if the user likes to watch the situation like that Nakata 
Hidetoshi #28 passed, Tomoyuki Hirase #17 received the pass and shot, the 
user just input the matters below into the items on the window. 



1. Related Player 1: Hidetoshi Nakata 

2. Related Player 2: Tomoyuki Hirase 

3. Related Player 3: N/A 

4. Point Difference: 1 <- (input either 1, 2, or none) 

5 5. Situation: Leading <- (input either leading, losing, or tie) 

6. Play: Pass <- (input play type such as pass or shoot, etc.) 

7. Time: 40 min. First Half <- (indicate desired time zone) 

By inputting the desired conditions like above, the scenes only 
correspond to the situations are displayed as a list from multiple games. 

3 10 This tool enables users to extract any desired situations voluntary from 

y 

y many data by inputting keywords. 

q < Set up window > 

a. Subject game display 

Displays the title data of list outputted games 
15 b. Analysis subject team change button 
^ By clicking the opponent team button, the user can change analysis 

subject team. 

c. Analysis subject player change pull down menu 
The user can change the analysis subject player by selecting new 

20 player from the analysis subject pull down menu. 

d. Play list number button 
It manages the list from the start of the game through consecutive 

number. The user can search 2D animation of the formation analysis screen 
by clicking play list number button. 
25 e. Play list table window 

It displays the list of each play unit which is numbered form the start 
of the game. For outputted form, the display form is changed depending on 
which analysis the user has progressed. 

Formation Analysis: All List Outputted 

30 Player Data Analysis: All List Outputted with emphasizing 
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the subject player 
Team Data Analysis: All List Outputted with emphasizing 

the subject team 

f. Close Button 

It brings the user to one analysis screen before such as formation 
analysis, player analysis, or team data analysis. 

Industrial Applicability 

The time data processing system of the present invention contains an 
image recording device to record the specified subjects, a data processing 
device that creates a time related data list to display the positions and 
movements of the subjects over time, an image motioning device to translate 
the aforesaid data into motion images, and a display device to display at 
least either the time related data list or the motion images translated from 
data. This enables a visual analysis and storing the analyzed data 
regarding individual players and team data depending on various purposes. 
Further, the data, demanded by coaches of professionals like soccer team, 
judges, official recorders and media personnel, is able to be analyzed and 
extracted through the automatic following technology, which makes it 
possible to completely trace the movements of the players in a game from 
image materials that can be recorded at a relatively low cost. 

The time data processing system of the present invention contains of 
a data processing device, command input device, interface device, and an 
image display device. The data processing device saves in its memory, the 
formatted data that is derived from the image data of the game. The input 
device is connected to the data processing device and multiple commands can 
be accepted. The intex-face device inputs and also produces the translated 
data. The image display data connected to the interface device inputs the 
data produced by the interface device to display it on the screen. This 
facilitates analysis by offering a means of visualizing data according to the 
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various purposes, and furthermore, the analysis results can be saved. 
Further, the data, demanded by coaches of professionals like soccer team, 
judges, official recorders and media personnel, is able to be analyzed and 
extracted through the automatic following technology, which makes it 
possible to completely trace the movements of the players in a game from 
image materials that can be recorded at a relatively low cost. 
The time data processing method of the present invention is achieved 
through the filming of the specified subject, the creation of the data list 
illustrating the position and movement over time, the creation of a motion 
image of the position and movement of the subjects through the data list, 
and displaying at least either the time related data list or the motion images. 
This enables a visual analysis and storing the analyzed data regarding 
individual players and team data depending on various purposes. Further, 
the data, demanded by coaches of professionals like soccer team, judges, 
official recorders and media personnel, is able to be analyzed and extracted 
through the automatic following technology, which makes it possible to 
completely trace the movements of the players in a game from image 
materials that can be recorded at a relatively low cost. 

The time data processing method of the present invention is achieved 
through the production of the image data, the processing of the data based on 
the designated format, the storage of the processed data in its memory, the 
translation of the formatted data according to the inputted commands and, 
displaying the translated data. This enables a visual analysis and storing 
the analyzed data regarding individual players and team data depending on 
various purposes. Further, the data, demanded by coaches of professionals 
like soccer team, judges, official recorders and media personnel, is able to be 
analyzed and extracted through the automatic following technology, which 
makes it possible to completely trace the movements of the players in a game 
from image materials that can be recorded at a relatively low cost. 
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